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Abstract. We study a model of repeated interaction between quantum sys- 
tems which can be thought of as a non-commutative Markov chain. It is shown 
that there exists an outgoing Cuntz scattering system associated to this model 
which induces an input-output formalism with a transfer function correspond- 
ing to a multi-analytic operator, in the sense of multivariate operator theory. 
Finally we show that observability for this system is closely related to the 
scattering theory of non-commutative Markov chains. 



1. Introduction 

The purpose of this paper is to point to an interesting connection between non- 
commutative Markov chains, which are a well known mathematical m odel fo r open 
quantum systems embedded into an environment (see for example Kii03l | for a 
recent survey), and multi-analytic operators, which are a central idea in the de- 
velopment of multivariate operator theory (as described for example in [Po95]). 
Though some hints about such connections between non-commutative probability 
theory a nd mu l tivaria t e operator th eory can be found in the literature, see for 
example [Bh96l . iBhOll . IGo04 IDGOTI . this is not widely appreciated and a more 
systematic investigation is missing. We want to present an argument that both 
fields can benefit from each other and make a start by studying a rather elemen- 
tary mathematical toy model from this point of view. Let us describe some more 
background in order to clarify the developments and applications we have in mind. 

The theory of open quantum systems embedded into an environment has been 
driven more and more to the language of linear systems theory, input- output for- 
malisms and control. We only mention the theo reti cal physics survey in GZ0(3l | and 
the recent investigations on quantum networks |GJ| | . The use of Laplace transforms 
and analytic functions is routine in classical linear systems and control theory but 
it is not at all obvious how to generalize this part of the theory to the quantum 
world. Though a noti on o f transfer function for bosonic fields has been recently 
developed jYK03a. YK03lj | . see also ^GJ . GGY08], we do not follow this approach 
here but instead we suggest to introduce analyticity into the theory of quantum 
systems by the use of multi-analytic operators. 
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These operators, also known as analytic intertwin inK operators in BV05|, have 
been introduced and studied in in the develo pment of a multi- 

variable version for row contractions of the Sz.-Nagy/Foias-theory SF7C| and it has 
been shown that many aspects of theclassical theory of analytic functions generalize 
to this setting, see for example |Po06| . Among them are techniques which are 
relevant to linear systems and control. 

It is therefore clear that the study of quantum systems would benefit if it is 
possible to construct such operators as a generalized type of transfer function for 
these systems. We show in this paper that if we can model the quantum system 
and the interaction in a certain way by a non-commutative Markov chain then this 
is indeed possible. 

As this seems to be a new idea and as our aims in this paper are partly exposi- 
tory, to convince theoretical physicists working on interactions of quantum systems 
and pure mathematicians working on multivariate operator theory that there ex- 
ists a promising intersection of their interests, we have made no attempt to study 
the most general model but instead we investigate a very elementary discrete time 
toy model of repeated interactions between an open system and its environment. 
Though stripped to its bare basics it nevertheless already exhibits some interesting 
features which we expect to be typical. The model is defined in a purely mathe- 
matical way and then interpreted physically in Section [21 In Section [3] we shift our 
attention to multivariate operator theory and prove that we can find an outgoing 
Cuntz scattering system in the sense of [BV05j inside our model of repeated interac- 
tion. It is well known that this leads to a transfer function which in fact corresponds 
to a multi-analytic operator. We work out in Section |4] how this transfer function 
and related concepts can be developed in a convenient way for our setting and we 
give a physical interpretation in terms of certain experimental records. Another 
concept motivated from a control point of view is observability. We show in Sec- 
tion [5] that in our setting observability is closel y relate d to a scattering theory for 
non-commutative Markov chains introduced in whose further development 



Go04 . GKLOd | in fact led the author into the direction followed in this paper. We 



refer to the end of Section \5\ for a more detailed discussion of this scattering inter- 
pretation which gives further evidence that our transfer function via multivariate 
operator theory is also a natural tool for the study of the physical system. We fur- 
ther comment there about some closely rela ted investiga tions about characteristic 
functions of ergodic tuples and of liftings in DGOTI . IDG | . 



2. A MODEL FOR REPEATED INTERACTIONS 

We want to study a very elementary mathematical model for an interaction 
between quantum systems. The model is specified by a few operator theoretic 
data. 

Definition 2.1. Given 



three Hilbert spaces Ti., IC, V 



a unitary operator U : H ® IC Ti. ®V (i.e. U*U = UU* = 1) 
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unit vectors i}^ e H, ri'^ G JC, G V such that 

we say that U is an interaction with vacuum vectors VL^ .Vl'^ . 

We can form the infinite tensor products JCoo '■= (S^-T ^ ^"^^ ^oo '■= ^ with 



distinguished unit vectors = fl'^ and 17^ = , see \KR8^ . 11.5.29. 

We denote the £-th copies by JCi and ilf and use a natural notation built upon it. 
For example, for flf (g) we write 2]i f^'' ^3 (X" /C4 (X) /C5 we write /C[3_5] and 
identify it with 2] "8) ^^^[3,5] S?) C /Coo- Similarly for V where we have spaces 

'P[m,n] ^-iid vectors ^^„]- Embeddings without further explanations are always 
understood in such a way, using the vacuum vectors, for example 

We can now define repeated interactions. For e N let 

Ut-T-L® JCoo -> 7i «) /C[i,^_i] (^Vt® K.[i+i^oo) 

be the unitary operator which is equal to U on Ti ® JCi and which acts identically 
on the other factors of the tensor product. Then the repeated interaction up to 
time n G N is defined by 

u{n) ■.= Un...Ui -.n^JCoo ^n® Vii^,,] ® /C[„+i,oo) 



A physical interpretation of a very similar scheme is developed in detail in BHJ | . 
Let us quickly sketch the basic ideas. To do that assume for the moment that K, = V 
and fl^ = and that J7 is a unitary operator on Ti ® JC. We may think of Ti 
as the (quantum-mechanical) Hilbert space of an atom, JC as the Hilbert space of 
a (portion of a) light beam and J7 as a (toy model of their) quantum mechanical 
interaction. After the interaction the (pure) state rj £?i®)JC of the coupled system 
is changed into Ur] G H. ® JC (Schrodinger picture). The only thing we require 
from our vacuum vectors and is that their tensor product represents a state 
which is not affected by the interaction U . 

If we further assume that at time 1 an interaction happens for Ti ® JCi^ after 
the interaction this portion of the light beam goes away from the atom forever but 
another portion of the light beam described by JC2 reaches the atom and interacts 
at time 2, etc., then we obtain a repeated inter action and U{n) = Un ■ ■ - Ui is the 



Schrodinger dynamics up to time n. In fact, in BHJl | there is a detailed derivation 
of the Heisenberg dynamics X 1^ U {n)* X U(n) fo r obse rvables X which confirms 
our sketchy interpretation above. It is shown in |BHJ | that this toy model of a 



quantum mechanical atom-field interaction allows a discussion of many of the basic 
equations and constructions of quantum filtering and quantum control which is 
parallel to the usual continuous time treatment. Moreover the continuous time 
results can be obtained from that as a sca ling limit. Repeated interactions of a 
similar type are also investigated in |BG08I |. 
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Remark 2.2. The reader who wants to see the propagator (unitary time evolution 
operator) for this repeated interaction in a more explicit way should consult the 
literature ab out no n-commutative Markov chains and their coupling structure, see 
for example |Ku03I | for a survey. For our interactions this gives a description which 
is essentially equivalent to the model presented here but it includes additionally the 
dynamics of the beam outside the range of the interaction as a tensor shift. More 
precisely, consider the enlarged space H IC and let S be the tensor shift to 

the left (on the copies of /C while acting identically on H). Then (with 
C/(0) := 1) can be thought of as a right unitary cocycle for S , i.e. U{n + m) = 
S~'^U{m)S"U{n), and we obtain an evolution by a unitary group (C^")^^^ ^^^^ 
that f/" — S'^U{n) for n e Nq. The unitary operator U is the propagator of the 
coupled atom-field system which includes both the interactions and the movement 
of the beam to the left before and after the interactions. 

Hence from this enlarged point of view our model of repeated interaction is 
actually what physicists would call an interaction picture of the dynamics (but we 
shall nevertheless, with a slight abuse of language, continue to call it Schrodinger 
resp. Heisenberg picture if we change states resp. observables using U{n) in the 
original model). 

While the enlarged model is useful for the study of the complete propagator and 
for other structural questions we will not use it in this paper because we are more 
interested in the input-output map of the system and for this purpose the original 
model of repeated interaction presented before is simpler and more direct. So from 
now on we work with the model of interaction specified in Definition 12.11 and the 
one-sided model of repeated interaction built from it. 

We can think of our model as a non-commutative Markov chain or, from a 
physicist's point of view, as a Markovian approximation of a repeated atom-field 
interaction. Let us elaborate a bit on the Markovianity. In the Heisenberg picture 
the change of an observable X S B{'H) until time n compressed to H is given by 

ZniX) = Ph U{n)* X ® 1 U{n)\H, 

where Pu denotes the orthogonal projection from Ti <E) ICoo onto Ti,. Let (e^) be an 
orthonormal basis of the Hilbert space V. For ^ e we get 

t/(e®l^'=)-5]A,e®e, 

j 

with operators Aj E B{T-l). Then a short computation yields 



Z„(X)= ^ Al...Al^XA,^...A,,=Z-{X), 
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where Z — J^j ' ■ B{H) B{H) is a unital completely positive map called 
the transition operator of the non-commutative Markov chain. The semigroup 
property of the compressed dynamics established above is one of the basic features 
of Markovianity which for classical Ma rkov c hains is expressed by the Chapman- 



Kolmogorov equations, see for example [Fe68|. 
Our condition about vacuum vectors yields 

i.e., the vector state induced by ii^ is invariant for Z. 

3. Outgoing Cuntz scattering systems 

To develop a different approach to the model in the previous se ction we review 
some no tions from multivariable operator theory. See for example [Po89aL |Po89hl 

bgmqI. 



Suppose Ti, . . . ,Td £ B{C) for a Hilbcrt space C. We allow d — oo but simplify 
our notation by pretending that d is finite and leave in the following the suitable 
modifications and limits to the reader. Then 

T = (Ti, . . . ,Td) is called a row contraction if it is contractive as an operator 
from 0^ £ to £ or, equivalently, if X^i TjT* < 1. 

T ~ (Ti, . . . ,T(j) is called a row isometry if it is isometric as an operator from 
0^ £ to £ or, equivalently, if the Tj are isometries with orthogonal ranges. 

T = (Ti, . . . , Td) is called a row unitary if it is unitary (isometric and surjective) 
as an operator from 0^£ to £ or, equivalently, if the orthogonal ranges of the 
isometries Tj together span £. 

A row isometry T = (Ti, . . . , Td) is called a row shift if there exists a subspace £ 
of £ (the wandering subspace) such that £ = 0Q,gi;'+ Ta£. Here (as always in this 
paper) denotes an orthogonal sum, FJ^ is the free semigroup with generators 
1, . . . , d. If a e is the word ae . . .ai of length \a\ — £ (where aj e {1, . . . , d}) 
then Ta^Tai... T^^. For the empty word we define |0| = and r0 1. 

Recall the following definition from BV05l |. Chapter 5. An outgoing Cuntz scat- 



tering system is a collection 

{c,v = {Vi,...,Vd),gt,G) 

where F is a row isometry on the Hilbert space £ and and Q are subspaces of 
£ such that 

(1) Q+ is the smallest ]/-invariant subspace containing 

£* :— C Q spanj^i^,,,^d VjC , 
thus V_\g+ is a row shift and t/+ = ®a&p+ Va£* 

(2) V\g is a row shift, thus Q — 0^^^?+ Va£ with 

£ :=g Q spanj=i^,,,^d V-jQ . 

Remark 3.1. Note that t/+ and £"* are determined by £ and V_ and hence in prin- 
ciple could be omitted from the defining data. But the idea behind this concept 
(the 'scattering') is to study the relative position of the two row shifts. The decom- 
position £ = (£ Q Q ^) ® g+ gives the Wold decomposition of VI as a row unitary 
plus a row shift, see Po89a|, Theorem 1.3, which is a multi-variable version of the 



classical Wold decomposition of an isometry. 
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Now we associate an outgoing Cuntz scattering system to an interaction U with 
vacuum vectors 51^, fi'^, il^ , as specified in Definition 12.11 We define the data of 
the scattering system in terms of those data as follows: 

C:^[n® /Coo)° {n ® /Coo) e c(r!« ® O^), 

For ^ ® 7] e (8) /Coo and an orthonormal basis (ej)^_-^ d'^^'^ 

Vj{i®Ti) [/*(^(8)ej)(g)77e {U ® ICi) ® lC[2,oo) 

which by linear extension defines V_ = (Vi , . . . , Vd) on (7i(8)/Coo)° (details in Theorem 
I3.3p . As discussed above, and C/+ = @^^p+ Va£* are implicitly defined as the 
shift part of V_. Finally 

Note that y = (Vi , . . . , Vd) depends on the choice of the orthonormal basis (ej)^-_-^ 
of V but a change of basis by a unitary d x rf-matrix has the same effect on the 
Vj and leads to a closely related system which for many purposes can be identified 
with the original one. 

For technical reasons we also define V_ as the extension oiV_toT-L® /Coo given 
by the same formula, in other words we have 

We need some auxiliary operators. By Q[i^n] we denote the orthogonal projection 
from T'oo to Vii^n] C T'oo- Further we define Qn'-Ti.® Vii^n] ® /C[n+i.oo) ^ "^[1,™] C 
T'oo by 

which also maps onto V[i,n]- 

Proposition 3.2. There exists a coisometry W : H ® /Coo ^ Voo such that 

W = sot- lim QnU(n), 

W* = sot- lim U{n)*\v^, 
where sot stands for 'strong operator topology '. 

By restriction we obtain a coisometry W : [Ti ® /Coo)° (^oo)° '■— Voo Q Cfl^. 

Proof. We start by constructing the adjoint W*. We have U^\-Pi ■ Vi ~ ^l^®Vi -+ 
Ti.(^lCe and hm„^oo . . . U*( clearly exists for ( S Ua'>o '^[o.n]- In fact, because 
of the invariance property of the vacuum vectors only finitely many of the act 
nontrivially on C. Because the are isometrics we obtain an isometric extension 
W* to the closure T'oo- Its adjoint is a coisometry W : H /Coo ~^ 'Poo- More 
explicitly, for rj £71® /C[i „j] and C, G 'P[i,n\ and m < n we obtain 

(t?77, C) = (?7, W*C) ^ {Q^U{n)r,, O 

We conclude that ^ 

Q[i,n]Wr] = QnU{n)r] 

For n — !■ cx) the left hand side converges to Wrj and we have 

Wr] — lim QnU{n)rj 
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Finally we can extend this formula from lJm>i ^ ^ ^[i.m] to the whole of 7i (g) /Coo 
by continuity. The restriction W acts as shown because VF(ri^ il^) = fl^. □ 

Theorem 3.3. Let U be an interaction with vacuum vectors fi'^, , as spec- 
ified in Definition \2. 1[ Then with the definitions above 

{{n(g>JCoor,v^{Vi,...,Vd),gt,G) 

is an outgoing Cuntz scattering system. We obtain an explicit formula for as 
follows. 

8, = W*y cn(E)JCi 

with 

Finally we have 

where H" := Ti. Q C^'^ . 

Proof. The Vj are isometrics with orthogonal ranges because the ej form an or- 
thonormal set and U* is isometric. Note that because the ej form a basis, y_ is even 
a row unitary, i.e., spanj=i^, ,^d VjC^ /Coo) =7^(8' /Coo- 
Now suppose that J2i S.i^'Hi^^® ICoo)° with £ H and rn e /Coo- Further 
suppose that C (g) «) e (g) "Poo ^ ^oo • Then for all j 

{VJy2^^<E>v^,W*C) = {y2u* (6 ® e, ) ® ?7„ hm U*,... K ® CT ® 

i i 

i 

because Y.i 6 «> r/j -L rJ'" (g . 

By choosing C^f = Vl^ we conclude that {Ti g) JCoo)° is invariant for all Vj and 
hence F is a row isometry on {H. (g /Coo)°- 

Clearly M/*3^ C H (g /Ci and W^*3^ ± f]'" (g f]^, hence also W*y ciU® IC^)°. 

By choosing -L rjf , i.e. fl^ <E CT ^[2,00) G 3^, we conclude that W*y 
is orthogonal to spanj=i^,,,^d VjCH /Coo)°- To prove that W*y is equal to the 
wandering subspace 5* of V_ it remains to be shown that no other vectors are 
orthogonal to spanj=i^,,,^d VjC^ /Coo)°- In fact, suppose 77 g (g /Coo)° is 
orthogonal not only to spanj=i ,,,,d Vj(T-L ® /Coo)° — spanj=i^,,,^d Vji'H (g /Coo)° but 
also to W*y. The latter (together with 77 e (H«)/Coo)°) means that for all e Pi 

,7±[/*(r!«®cr)®f^[^,oo) 

which gives _L spanj^i d Vj (ri^®51^). Combined with 77 ± spanj^i d V}(7ig) 
/Coo)° this implies 

77 ± Spanj^i^,,,^d Vj{Ti g) /Coo) = W g) /Coo ■ 

The last equality follows from the fact that y is a row unitary. We conclude that 
77 = 0. 

Further it is clear that £ — Ti ® {^'i)^ ® 00) contained in {Ti g) /Coo)°- 
Now we prove that Va£ and Vp£ are orthogonal to each other li a ^ j3 ui . If 
|q;| = \(3\ but a ^ fi then even the ranges of Va and Vp are orthogonal (because V_ 
is a row isometry). But if, say, \a\ > \f3\ then ± VpE follows by considering 
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the form of £ (consider the mner product at the tensor factor K,\a\+i)- FinaUy, to 
see that g 0c.eF+ ^ {U® /Coo)" e Ti" check by induction that for all n e N 

d 

= (Cn^®7^°) ®£®0V,5©...® Vo,£ . 

Restricting to [Ti. ® /Coo)° and with n ^ oo we obtain the result. □ 

Note that if d = dim V >2 then dim — dimy = d — 1 > 1 and the scattering 
system {{U ® JCoof ,]L= [Vi, ■ ■ ■ ,Vd),Qt ,Q) is never trivial. 

In any outgoing Cuntz scattering system it is interesting to examine the relative 
position of the two embedded row shifts. In our case, having identified the wander- 
ing subspace as W*y, it is more convenient to work instead with an equivalent 
row shift with wandering subspace y. The following considerations help to keep 
track of the relative position and will be used in the analysis of this problem in the 
following sections. 

Proposition 3.4. Let S_ = {Si, . . . , 5*^) with 

Sj • l^OQ ^ ^QC 

C ^ ej^C (G ^i<»^[2,oo)) 

Then for j — 1, . . . , d 

If S_~ {Si, . . . , Sd) is the restriction to {VooY then 

SjW = WVj 

Proof. Note that for Q e Vt 

{SjY Ci® C,2® ■ ■ ■ = {ej,Ci) C,2® ■ ■ . 
and hence we obtain for ^ e rj ^ /Coo, Ci G 'Pi 

( {WVj)^ ®ri, C,l®C,2®---®C,n® ^Jn+l^oo) ) 
= {%^®T1, WXi ®C2®-.-®Qn® f^^.+ l.co) > 

= {U*{^® ej) ®ri, C/i* ...[/* Ci ® C2 ® ••• ® C« ® ^fn+i,^) ) 
= {^®ej®ri, U;...U*^n'^ ®Ci®C,2® ---^Cn® ) 

= ((5^,W^)^®r;, Ci®C2...Cn®r!^+i,oo)> 
The intertwining relation for the restrictions is a direct consequence. □ 

Corollary 3.5. S_ is a row unitary but S_ is a row shift with wandering subspace 
(rif )^ ~ y. It is equivalent to the row shift on in Theorem \3.S[ via the 

intertwiner W . In particular 

£, - w*y, w£,^y, Gt = w*{r^)°, wQt = {VooT 
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4. Ft-LINEAR SYSTEMS AND TRANSFER FUNCTIONS 



For our model of an interaction U with vacuum vectors f2^, ft'^, ft^ wc now 
want to study certain generalizations of linear systems theory which turn out to 
be closely connected to the outgoing Cuntz scattering system ((H ® /Coo)°, Y. = 
(Vi, . . . , Vd), Gt 1 G) which we have constructed in the last section. We define 
the input space U := £ ^ Ti. ® {Vlf)^ ® n'^^ d {H ® lCoo)° , 
the output space y := (fif ® oo) ^ (^oo)° 
With H®IC = HS)U the interaction U maps H®U onto H i 
y (identifying V and Vi ) . Hence for j = 1 , . . . , c? we can define 



) V which contains 



Aj -.n-^n, Bj -.u ^H, c -.n^y, D-.u^y 



by 



d 

E 



PyU{£,®v) =■■ C^ + D^, 

where Ti., 7] £ U and (ej)^_j^ is an orthonormal basis of V and Py is the 
orthogonal projection onto y (such a notation will also be used for other subspaces 
in the following). 



Remark 4.1. Note that we found Ai, . . . ,Ad e B{T-C) earlier when we considered 
the transition operator Z{-) = A* ■ Aj : B{H) — > B{'H) of the non-commutative 
Markov chain. The setting is not so special as it may seem on first glance. In fact, 
if {Al, . . . ,v4J) : ^"j^iTi- — » 7i is an arbitrary row contraction then we can use 
dilation theory to construct an isometric dilation {Vi, . . . , Vd) (see |Po89a for this 
kind of dilation theory) and to construct Hilbcrt spaces JC and V and a unit ary 
U : Ti (g) /C — > H ^ V which is related to Ai, . . . ,Ad as above. See Go04| or 



DG07|, Section 1, where such a coisometry U is explicitly constructed which can 



be extended to a unitary on enlarged spaces. It is a consequence of the existence 
of vacuum vecto rs in D efinition 12.11 that is a common eigenvector for the tuple 
Al, . . . ,Ad (see Go04| - A. 5.1) and hence, conversely, if one starts with the tuple 
one has to assume this property in order to arrive at the setting of Definition 12.11 



Further we define 



f Al Bi\ 



Cu := 



Ad 



Bd 
D I 



which is called a colligation (of operators). 

As usual, the colligation Cu gives rise to a Fj' - linear sy stem Sfj (also called a 
non-commutative Fornasini-Marchesini system in BGM06| . referring to [FM78j ). 
given by 

x{ja) — Aj x{a) + Bj u{a) 
y{a) — C x{a) + Du{a), 
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where j = 1, . . . ,d, further a, ja (concatenation) arc words in FJ' and 

x:F+^n, u-.F+^U, y.F+^y. 
Given a;(0) and u we can use S^/ to compute x and y recursively. 

11 




dyadic tree for = 2 



A very elegant way to encode all the information about the evolution of an F^- 
linear system into a single mathematical object is the use of a transfer function. 
For this we define the 'Fourier transform' of x as 



i{z) = x{a)z^ 



where = Za^ ■ ■ ■ Za^ if a = a„ . . . cii G F^^ and z = (zi, . . . , Zd) is a d-tuple 
of formal non-commuting indeterminates. Similarly u{z) — J2aeF+ u{a)z°' and 

Then it is easy to check that, if a;(0) = 0, we have the input-output relation 

y{z) = Qu{z) u{z) 

where 

Quiz) := :=D + C ^ A^Bjzl^^ 

j=l,...,d 

The arc operators from U to 3^. Multiplication of the z-variablcs is done by 
concatenation of exponents and the coefficients are always assumed to commute 
with the z-variables. We call the formal non-commutative power series Ou the 
transfer function associated to the interaction U. 

Now we want to proceed from formal power series to operators between Hilbert 
spaces. 

Theorem 4.2. The input-output relation 

y{z) = Qu{z) u{z) 

corresponds to a contraction 
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which (with x{ 
quence y. 



0) maps an input sequence u to the corresponding output se- 



Proof. We give a proof with colligations which illustrates the connections with the 
outgoing Cuntz scattering system constructed in the previous section. One would 
like to use the colligation Cjj but one quickly observes that Cu is in general not 
contractive. In fact, the colligation obtained by removing the last row (C, D) 
is already unitary. We note however that the state variables x{a) S H can be 
changed arbitrarily by scalar multiples of fi^ without changing the input-output 
map (because y{a) = Py U{x{a) + u[a)) and Py U(fl^ fl'^) = 0). Hence we can 
replace the colligation Cu by the colligation 



r° — 



^d 



\ C° D J 
where W -.^TiQ Cfl'^ and 



are restrictions resp . comp ressions of Aj, Bj, C, D. 

Now recall from BVOSj . Chapter 5.2, that given an outgoing Cuntz scattering 



system {{H /Coo)°, V={Vi,..., Vd), 5+, G) such that {H ® /Coo)° ^n^^g (as 
constructed by us in Theorem 13. 3p we can associate a unitary colligation 



(A, B,^ 

Ad Bd 

\ c b J 



by {Aj, Bj) = Ph''V*\u''®s, (C, D) = P^Jw^ee- Unitarity follows directly from 
the geometry of the outgoing Cuntz scattering system, see BV051. 

Now observe that [A°, B°) = Pn''®e,U\H''@£ (identifying n° and ® e^) and 
iC", D) = PyC/|w°®£ and hence 

U*{A°, B°) = U*Pu''®ejU\u''@£ = Pu*n''®<ij\n''@s 

= PvMn^®£ = V,PnoV;\no^£ = V,{A,, B,) 
U*{C",D) = U*PyU\n^^£^Pu'y\m®e^{C,b) 



because f , — W*y^ by Thcorcm l3.31 which with the identifications used here is the 
same as U*y. It follows that the colligation Cgr is also unitary. This implies that 
Mqjj is contractive, by summing over all a the equations 



5^|x°(ja)p-K(a)p = Kap-|y(a)p 

(with x°(0) — 0), which can be obtained from the unitary colligation Cj} replacing 
Cu- □ 
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The operator Mq^ has the property that it intertwines with right translation, 
i.e., for aU J = 1, . . . , c? 



Such operators have b een cal led analytic intertwining operators in BV05l | and multi- 
analytic operators in Po95l | which refers to the fact that in the theory of these 
operators there are many analogues to the theory of multiplication operators by 
analytic functions on Hardy spaces. The non-commutative power series Qu is 
called the symbol of Afe„ . As discussed in the introduction it was one of the 
motivations for this paper to make this theory available for the study of interaction 
models and non-commutative Markov chains. Note further that b ecause Mq^ is 



a contraction the transfer function Qu belongs to what in [BV05[, 2.4, is called 
the non- commutative S chur class Sn c .d y)- To compare with other work in the 
literature (for example PoQSl . IDGOTI . IDGI |) we mention that i^{Fll,U) is naturally 
identified with a free Fock space tensored with U in which case 'multi-analytic' 
refers to intertwining with creation operators. While this is a very useful way 
to think about it we won't use it in this paper but write our formulas with the 
indeterminates z. 

To understand what the transfer function Qjj can tell us about our physical 
model of interaction we construct a more explicit dictionary between the multiplica- 
tive tensor product description and the additive language of i^^-linear systems. 

We can interpret {z")^^p+ as an orthonormal basis of C) and X]aeF+ vi^)^'^ 

for square integrable coefficients y{a) G 3^ as a series converging to an element of 
^^(^^ ,3^)- It is natural to map C G 3^ to (z® e ^^(^/,3^) and, based on Corollary 
13. 5[ to extend this to a unitary operator 

where C G 3^ and a = ai . . . q;„ is the reverse of a = «„... ai G . We have an 
intertwining relation 

Vv{s^c) - (rpC)z". 

Similarly, based on Theorem 13.31 we can define a unitary operator 

C®VaV ^ C ® »7 Z" , 

where ^ G 7i°, G W. Here the intertwining relation is 

By including the coisometry W from Proposition 13 . 21 we can form the following 
useful commuting diagram. 

Theorem 4.3. Let Tw be defined by the following commutative diagram: 

w 



n°®e^{F+,u) 
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i.e., Tw — T-pWTjJ^. Then we have 

Proof. Combining the intertwining relations of T/c and T-p with the intertwining 
relation Sj W — W Vj from Proposition 13.41 we obtain for i] <^ U, (i ^ , j = 

Twivz'^z^) =rpH/r-i(?7z'^z^) ^TvWVjV^ri 
= Tj, Sj Sj^Wt] = (Fp Wt]) zf^z' = Tw {v z^) z' 
and we conclude that rM/|^2(^+ is a multi-analytic operator. To find its symbol 
it is enough to compute TwV for rj £ U identified with r] z'^ £ £^{F^,U). For 
a = Qn-i ■ ■ .Oil e , so that n = |q;| + 1 > 1 (which for n = 1 means a — 0), let 
Pa be the orthogonal projection onto 

r^H / e iHF^,y) -f^Cz" ior some ( e y} = S^y 

(which for rt = 1 is 3^). From Proposition 13 . 21 we obtain 

PaWTj^Pa U{n)r) ^PaUn... UiT] 

and now we can explicitly compute with the associated i^^-linear system T,u from 
Section g] 

P U U^n - [ if n = l,a = 9 

But this is exactly 0|^''?7 for the coefficient Q^j^^ of the transfer function 8(7, hence 
^w\i2|^p+^) = Mq^. □ 

Clearly this commuting diagram provides another proof for Theorem 14. 2 1 In the 
rest of this section we want to use our insights to give a very direct interpretation 
of what the transfer function means in a physical model of repeated interaction 
based on the axioms in Definition 12.11 As in Section [5] we think of H as the 
(quantum mechanical) Hilbert space of an atom, JCg as the Hilbert space of a part 
of a light beam or field which interacts with the atom at time £. We take K. = V 
(though it makes sense to distinguish mentally between /C^ as the Hilbert space 
at time £ immediately before and Ve as the Hilbert space at time £ immediately 
after the interaction). We think of fl^ as a vacuum state of the atom and of 
ri'^ = in /C = P as a state indicating that no photon is present. Then r] £ U ~ 
H (g) {^f)'^ (8) J^l^ <Z Ti. ® /Coo represents a vector state with photons arriving 
at time 1 and stimulating an interaction between the atom and the field, but no 
further photons arriving at later times. Nevertheless it may happen that some 
activity (emission) is induced which goes on for a longer period. To describe it 
quantitatively consider again for a — a„-i . . . ai G F'^ the projection P^ which is 
the orthogonal projection onto 

eai® ® {^Z)^ ® f^[n+l,oo), 

already introduced in the proof of Theorem l4.3l In our physical interpretation it cor- 
responds to the following event: We measure data ai, . . . , q;„_i at times 1, . . . , n— 1 
in the field, finally there is a last detection of photons corresponding to (f^^)^ at 
time n, nothing happens after time n. This experimental record is obtained by 
measuring (at times indexed by the positive integers) an observable Y £ B{V) with 
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eigenvectors ei, . . . , e^. Such lists of data have been used for indirect measurements 
of an atom, for quantum fi ltering and fo r updating protocols such as quantum tra- 



jectories, see for example jBHJl . |KM06| | for such work with discrete time models. 
In our case the formula 

P„ U{n)rj = e[;^77 

obtained in Theorem 14.31 shows, according to the usual probabilistic interpretation 
of quantum mechanics, that 

is the probability for the event described by Pa if we start in the state 77 at time 0. 
Actually the transfer function also keeps track of the complex amplitudes and con- 
tains additional coherent information. This means that we can think of the transfer 
function 6(7 as a convenient way to assemble such data into a single mathematical 
object. 

5. Observability and scattering 

The identification of an outgoing Cuntz scattering system in Theorem 13 .31 allows 
to introduce many familiar concepts from linear systems theory. We single out a 
natural notion of observability and discuss its relations with ideas about a scattering 
theory of non-commutative Markov chains. 

Definition 5.1. The operator 

Wo -.^TwIho : n" ^ e\F+,y) 



+ 



is called the observability operator. The -linear system is called (uniformly) 
observable if there exist m, M > such that for all ^ G Ti.° 

mur < E \\cAM' = \\wo^r<Mur- 

Similar o perato rs are also called Poisson kernels and interpreted accordingly by 
Popescu in Note that for dimJi < 00 observability means that the observ- 

ability operator Wq is injective. This has a direct interpretation in our model which 
motivates the terminology quite well in this setting: Observability means that in 
an experiment with no ^//-inputs we can, by determining all 3^-outputs at all times, 
reconstruct the original state ^ of the atom. We took the idea of uniform observ- 
ability from ^FFGK97j | where it is argued that this is a mathematically convenient 
generalization of observability for dimTi = 00. We will see in the next theorem 
that this is also the case in our model. Note that we can always choose M — 1 (by 
Theorem 14. 3p . so the crucial point for uniform observability is the existence of the 
uniform lower bound m > 0. 

It is sometimes useful to extend Wq to 

by setting Wq fl^ := 1 G C. If Wq is uniformly observable then the defining 
inequalities extend to Wq on Ti.. 

Theorem 5.2. The following assertions are equivalent: 
(a) The system is (uniformly) observable. 
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(b) The observability operator Wq is isometric. 

(c) The transition operator Z : B{Ti.) B{TL) is ergodic, 
i.e., its fixed point space is C 1. 

(d) W -.[n® /Coo)° {VooY unitary. 

If these assertions are valid then we further have 

(e) The transfer function Qjj is inner, i.e., the multi- analytic operator Mq^ : 
i^{F+,U) e^{F+,y) is isometric. 

If dimTi. < oo and diniV > 2 then we also have the converse direction (e) 
(a, 5, c, d). 

Proof, (d) (6) (a) is obvious. We now prove (a) ^ (d), hence establishing the 
equivalence of (a), (b) and (d). 

Given 7^ r/ € "H^/Coo, approximate it by 77' e 7^®/C[i.„] (for some n G N) such 
that 

"'-"■IK 

here m is the constant appearing in Definition 15.11 of (uniform) observability. 

Suppose for a moment that [/„... Uirj' — C ^ C ^ ^[ri+i 00) ^'^^^ ^' ^ H. and 
C' G 'P[i_n]- Using Proposition 13.21 we find that \\QmUn ■ . -Un . ■ .Uirf' \\ tends 
for 00 to ||VFr/ ||. But it also tends to || WoC' \\ \\C W which by (uniform) 

observability is greater or equal than y/m || II II C II ■ We conclude that in this case 
we have || W^??' |p > m || 77' ||^. In the general case we can always write Un ■ . .Uirj' — 
J2j <^ Cj ^[^-1-1,00) "^i*^ ^'3 ^ ^ ^^'^ orthogonal vectors Q e 7'[i,„]- By handhng 
the summands as above and summing up, we can verify the inequality above also 
in the general case, i.e., for all 77' e 7i /C[i^„] 

WWrt'f > m\\r,'f. 

Now we conclude that 

\\Wv\\ > \\Wv'\\-\\W{tj-v')\\ 

> ^/mh'\\-\\v-v'\\ 

> Vm ||'7|| ^ (V"^ + 1) 11^7 ^ '/'II > 0. 

Hence Wrj ^ for all 7^ 77 G ?i /Coo, i-e., W is injective. But by Proposition 
13.21 we also know that is a coisometry and an injective coisometry is unitary. 
Because W(^ft^ (g) 17^) = it is clear that W is unitary if and only if W is 
unitary. This proves (d). 

To include condition (c) we make u se of t he following well known facts about pos- 
itive maps, see for example A. 5. 2 in [Go04| for proofs. Because Z : B{H) — > B{Ti.) 
is positive with invariant vector state given by fi^ G 7i it follows that Z'^{p), with 
p being the one-dimensional projection onto CO^, forms an increasing sequence 
which sot-converges to a fixed point < x < 1 of Z. The map Z is ergodic if and 
only if X = 1. 

With the operators Qn introduced for Proposition 13.21 we find for ^ G 7i 

II Qn U(n)i ir = (p® 1 U{n)^, p(g> 1 U{n)^ ) = ( C/(7.)>® 1 U{n)^ ) = ( C, Z'\p)^ ) 
and hence 

lim \\QnUin)Cf = {^,xO, 
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where x is the fixed point of Z mentioned above. But from Proposition 13.21 we also 
know that hm„^oo || Qn U{n)£^ || ~ || W£^ || — || Wof ||- and we obtain 

l|M^oC||' = (e,a;C). 

Using this it is easy to see that (c) is equivalent to (&). In fact, if we assume (c), 
i.e. Z is ergodic, then cc = 1 and hence we have || Wq ^ || = for all £^ ^ H, which 
implies (6). If Z is not ergodic then x 1 and hence there exists a vector ^ g 7i so 
that 

\\wo^\\^^{^,xo <m', 

which contradicts (6). 

(c?) => (e) is clear because by Theorem 14.31 the operator Me„ is a restriction 
of r^y which is unitarily equivalent to W. To consider the converse direction we 
define 

Hscat ■.= nnw*Voo^cn^(B{^en" -. \\Wo^\\ = UW } 

From II Wo? II = II lim„_+oo Q U{n)^ \\ (Proposition [321) we infer that 

scat 

If we have (e), i.e. Mq^ = T]^\p^p+ is isometric, then we must also have 
Together this implies that 

u* {{He Hscat) ®v) c in e Hscat) 

If dimTL < oo and dimV > 2 then a comparison of the dimensions of the left and 
right hand side of this inclusion forces H Q TCscat = {0}, i.e. Hscat = H, which is 
clearly equivalent to (b) . Hence under the stated assumptions about dimensions we 
also have the implication (e) ^ (b). □ 



Some of the techniques used in the proof of Theorem 15.21 resem ble tho s e used 
in the s cattering theory of non-commutative Markov chains, see [KMOd. lGo04 
GKL06| . This is not an accident. In fact, a discrete time version of this theory 



can be based on the following data: a unital C*-algebra A with a state (j), another 
unital C*-algebra C with a state ip and an automorphism a of A^C which has 4>iS)tp 
as an invariant state. This automorphism is interpreted as an interaction and gives 
rise to a one-step dynamics of a non-commutative Markov chain. We may consider 
this setting as a generalization of our model where we only considered the algebras 
of all operators on a Hilbert space together with pure states. But in a way we can 
also reduce the general setting to our model by using the GNS-construction: Let 
H be the GNS-space of A with cyclic vector il^ and JC the GNS-space of C with 
cyclic vector ft'^. Define a unitary operator U :H® fi'^ ^ H® fi'^ by 

U* : y VL^^ ® OF- ^ a{y) VL^ ® Q'^ 

(We take this to be U* instead of U because the automorphism a acting on algebras 
of observables represents the Heisenberg picture while U in this paper is designed 
to represent the Schrodinger picture.) Then with JC = V and = fl^ we have 
constructed the setting of our Definition 12.11 and the results of this paper apply. In 
particular we may call the corresponding transfer function Qu the trans fer fun ction 



of the stationary state non-commutative Markov chain. It is shown in [Go04| that 



a substantial part of the scattering theory of these Markov chains can be studied 
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and simplified on the level of the GNS-constructio n. In particula r, as can be seen 
from comparing condition (c) of Theorem [521 with jGoO^ - 2.6, or |GKL06I |. Th.4.3, 
observability in the sense of Definition [HIT] is equivalent to asymptotic completeness 
in the scattering theory of the Markov chain. The notation TLscat introduced in the 
proof of Theorem 15.21 is motivated by the idea of scattering states: In our model 
this means that in the long run they asymptotically end up in what we called 
(g) Vqo which is completely disentangled from the atom described by Ti. From 
this point of view we can look at the approach in this paper as a way to generalize 
the scattering theory of non-commutative Markov chains to situations which are 
not asymptotically complete. The transfer function is t hen closely re l ated to (and 
generalizes) the Moeller operator in the terminology of KMOd Go04 . GKL06l |. 

Finally we want to comment about the relationship between this pape r an d 
the operator theoretic investigations about characteristic functions in DG07. , lDG |. 
Recall that we can write Z(-) — X]j ' ■ I3{H) B{H) for the transition 
operator and [A^, . . . , A'^) is a row contraction with a common eigenvector for 



Ai, 



,Ad, say Aj n 



H 



fi^ and € C, j = 1, . . . , c? (compare Remark l4.ll) . 



With n = Cn'^®n° and A° the compression of Aj to n° we have {A°)* = A*\n'' 



and we obtain block matrices of the form 



A* 





(A°)* 



i.e., {Al, . . . , AJ) i s a li fting in the terminology of [DG{. The characteristic func- 
tion introduced in DGj is a multi- analyt ic operator ass ociated to a lifting and the 
ergodic case is studied in detail in |DG07 |. As shown in DG07 |. Prop. 2.1, another 
condition equivalent to (a), (6), (c), (d) of our Theorem 15.21 is 

(c') {A°i, ...,A°) is stable, i.e., for all £_en° 



lim 



El 

I a I —71 



which is a variant of the close connection between observability and stability well 
known in linear systems theory, see for example the discussion in Chapter III of 
FFGK97f . 



The main diff erence betw een [DGOTl |DG| | and the investigations presented here 
is as follows. In DGOTl . IDG| we start from the tuple A or the map Z and use the 
theory of minimal isometric dilations. The multi-analytic operator obtained is thus 
a characteristic function associated to A or Z. In this paper we do not consider 
minimality but we start with the interaction U and obtain a multi-analytic operator 
which represents the transfer function of an input-output system associated to 
the interaction. This additional flexibility is very useful in the physical modeling 
because, unlike for classical Markov chains, there are quite different enviro nment s 
and interactions which give rise to the same transition operator Z, compare |Kii03l |. 
Hence we expect that the scheme developed here is more directly applicable to 
physical models. Of course the study of non-minimal dilations is also o f int erest 
for operator theory. On the other hand we note that in the setting of DG| the 
assumption of a one-dimensional eigenspace is dropped and the theory is much 
more general in another direction. A further integration of these schemes in the 
future may help to remove unnecessarily restrictive assumptions of the toy model 
considered in this paper and lead to the study of other and of more realistic models. 
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